Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex.

Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach - based on a convolutional neural network and an explanation technique - to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings.

Motor decoding from the posterior parietal cortex using deep neural networks.

Objective.Motor decoding is crucial to translate the neural activity for brain-computer interfaces (BCIs) and provides information on how motor states are encoded in the brain. Deep neural networks (DNNs) are emerging as promising neural decoders. Nevertheless, it is still unclear how different DNNs perform in different motor decoding problems and scenarios, and which network could be a good candidate for invasive BCIs.Approach.Fully-connected, convolutional, and recurrent neural networks (FCNNs, CNNs, RNNs) were designed and applied to decode motor states from neurons recorded from V6A area in the posterior parietal cortex (PPC) of macaques. Three motor tasks were considered, involving reaching and reach-to-grasping (the latter under two illumination conditions). DNNs decoded nine reaching endpoints in 3D space or five grip types using a sliding window approach within the trial course. To evaluate decoders simulating a broad variety of scenarios, the performance was also analyzed while artificially reducing the number of recorded neurons and trials, and while performing transfer learning from one task to another. Finally, the accuracy time course was used to analyze V6A motor encoding.Main results.DNNs outperformed a classic Naïve Bayes classifier, and CNNs additionally outperformed XGBoost and Support Vector Machine classifiers across the motor decoding problems. CNNs resulted the top-performing DNNs when using less neurons and trials, and task-to-task transfer learning improved performance especially in the low data regime. Lastly, V6A neurons encoded reaching and reach-to-grasping properties even from action planning, with the encoding of grip properties occurring later, closer to movement execution, and appearing weaker in darkness.Significance.Results suggest that CNNs are effective candidates to realize neural decoders for invasive BCIs in humans from PPC recordings also reducing BCI calibration times (transfer learning), and that a CNN-based data-driven analysis may provide insights about the encoding properties and the functional roles of brain regions.

Changes in brain rhythms and connectivity tracking fear acquisition and reversal.

Fear conditioning is used to investigate the neural bases of threat and anxiety, and to understand their flexible modifications when the environment changes. This study aims to examine the temporal evolution of brain rhythms using electroencephalographic signals recorded in healthy volunteers during a protocol of Pavlovian fear conditioning and reversal. Power changes and Granger connectivity in theta, alpha, and gamma bands are investigated from neuroelectrical activity reconstructed on the cortex. Results show a significant increase in theta power in the left (contralateral to electrical shock) portion of the midcingulate cortex during fear acquisition, and a significant decrease in alpha power in a broad network over the left posterior-frontal and parietal cortex. These changes occur since the initial trials for theta power, but require more trials (3/4) to develop for alpha, and are also present during reversal, despite being less pronounced. In both bands, relevant changes in connectivity are mainly evident in the last block of reversal, just when power differences attenuate. No significant changes in the gamma band were detected. We conclude that the increased theta rhythm in the cingulate cortex subserves fear acquisition and is transmitted to other cortical regions via increased functional connectivity allowing a fast theta synchronization, whereas the decrease in alpha power can represent a partial activation of motor and somatosensory areas contralateral to the shock side in the presence of a dangerous stimulus. In addition, connectivity changes at the end of reversal may reflect long-term alterations in synapses necessary to reverse the previously acquired contingencies.

A model of working memory for encoding multiple items and ordered sequences exploiting the theta-gamma code.

Recent experimental evidence suggests that oscillatory activity plays a pivotal role in the maintenance of information in working memory, both in rodents and humans. In particular, cross-frequency coupling between theta and gamma oscillations has been suggested as a core mechanism for multi-item memory. The aim of this work is to present an original neural network model, based on oscillating neural masses, to investigate mechanisms at the basis of working memory in different conditions. We show that this model, with different synapse values, can be used to address different problems, such as the reconstruction of an item from partial information, the maintenance of multiple items simultaneously in memory, without any sequential order, and the reconstruction of an ordered sequence starting from an initial cue. The model consists of four interconnected layers; synapses are trained using Hebbian and anti-Hebbian mechanisms, in order to synchronize features in the same items, and desynchronize features in different items. Simulations show that the trained network is able to desynchronize up to nine items without a fixed order using the gamma rhythm. Moreover, the network can replicate a sequence of items using a gamma rhythm nested inside a theta rhythm. The reduction in some parameters, mainly concerning the strength of GABAergic synapses, induce memory alterations which mimic neurological deficits. Finally, the network, isolated from the external environment ("imagination phase") and stimulated with high uniform noise, can randomly recover sequences previously learned, and link them together by exploiting the similarity among items.

Theta and alpha power track the acquisition and reversal of threat predictions and correlate with skin conductance response.

The ability to flexibly adjust one's threat predictions to meet the current environmental contingencies is crucial to survival. Nevertheless, its neural oscillatory correlates remain elusive in humans. Here, we tested whether changes in theta and alpha brain oscillations mark the updating of threat predictions and correlate with response of the peripheral nervous system. To this end, electroencephalogram and electrodermal activity were recorded in a group of healthy adults, who completed a Pavlovian threat conditioning task that included an acquisition and a reversal phase. Both theta and alpha power discriminated between threat and safety, with each frequency band showing unique patterns of modulations during acquisition and reversal. While changes in midcingulate theta power may learn the timing of an upcoming danger, alpha power may reflect the preparation of the somato-motor system. Additionally, ventromedial prefrontal cortex theta may play a role in the inhibition of previously acquired threat responses, when they are no longer appropriate. Finally, theta and alpha power correlated with skin conductance response, establishing a direct relationship between activation of the central and peripheral nervous systems. Taken together these results highlight the existence of multiple oscillatory systems that flexibly regulate their activity for the successful expression of threat responses in an ever-changing environment.

A neurocomputational analysis of visual bias on bimanual tactile spatial perception during a crossmodal exposure.

Vision and touch both support spatial information processing. These sensory systems also exhibit highly specific interactions in spatial perception, which may reflect multisensory representations that are learned through visuo-tactile (VT) experiences. Recently, Wani and colleagues reported that task-irrelevant visual cues bias tactile perception, in a brightness-dependent manner, on a task requiring participants to detect unimanual and bimanual cues. Importantly, tactile performance remained spatially biased after VT exposure, even when no visual cues were presented. These effects on bimanual touch conceivably reflect cross-modal learning, but the neural substrates that are changed by VT experience are unclear. We previously described a neural network capable of simulating VT spatial interactions. Here, we exploited this model to test different hypotheses regarding potential network-level changes that may underlie the VT learning effects. Simulation results indicated that VT learning effects are inconsistent with plasticity restricted to unisensory visual and tactile hand representations. Similarly, VT learning effects were also inconsistent with changes restricted to the strength of inter-hemispheric inhibitory interactions. Instead, we found that both the hand representations and the inter-hemispheric inhibitory interactions need to be plastic to fully recapitulate VT learning effects. Our results imply that crossmodal learning of bimanual spatial perception involves multiple changes distributed over a VT processing cortical network.

A mechanistic model of ADHD as resulting from dopamine phasic/tonic imbalance during reinforcement learning.

Attention deficit hyperactivity disorder (ADHD) is the most common neurodevelopmental disorder in children. Although the involvement of dopamine in this disorder seems to be established, the nature of dopaminergic dysfunction remains controversial. The purpose of this study was to test whether the key response characteristics of ADHD could be simulated by a mechanistic model that combines a decrease in tonic dopaminergic activity with an increase in phasic responses in cortical-striatal loops during learning reinforcement. To this end, we combined a dynamic model of dopamine with a neurocomputational model of the basal ganglia with multiple action channels. We also included a dynamic model of tonic and phasic dopamine release and control, and a learning procedure driven by tonic and phasic dopamine levels. In the model, the dopamine imbalance is the result of impaired presynaptic regulation of dopamine at the terminal level. Using this model, virtual individuals from a dopamine imbalance group and a control group were trained to associate four stimuli with four actions with fully informative reinforcement feedback. In a second phase, they were tested without feedback. Subjects in the dopamine imbalance group showed poorer performance with more variable reaction times due to the presence of fast and very slow responses, difficulty in choosing between stimuli even when they were of high intensity, and greater sensitivity to noise. Learning history was also significantly more variable in the dopamine imbalance group, explaining 75% of the variability in reaction time using quadratic regression. The response profile of the virtual subjects varied as a function of the learning history variability index to produce increasingly severe impairment, beginning with an increase in response variability alone, then accumulating a decrease in performance and finally a learning deficit. Although ADHD is certainly a heterogeneous disorder, these results suggest that typical features of ADHD can be explained by a phasic/tonic imbalance in dopaminergic activity alone.

Bottom-up vs. top-down connectivity imbalance in individuals with high-autistic traits: An electroencephalographic study.

Brain connectivity is often altered in autism spectrum disorder (ASD). However, there is little consensus on the nature of these alterations, with studies pointing to either increased or decreased connectivity strength across the broad autism spectrum. An important confound in the interpretation of these contradictory results is the lack of information about the directionality of the tested connections. Here, we aimed at disambiguating these confounds by measuring differences in directed connectivity using EEG resting-state recordings in individuals with low and high autistic traits. Brain connectivity was estimated using temporal Granger Causality applied to cortical signals reconstructed from EEG. Between-group differences were summarized using centrality indices taken from graph theory (in degree, out degree, authority, and hubness). Results demonstrate that individuals with higher autistic traits exhibited a significant increase in authority and in degree in frontal regions involved in high-level mechanisms (emotional regulation, decision-making, and social cognition), suggesting that anterior areas mostly receive information from more posterior areas. Moreover, the same individuals exhibited a significant increase in the hubness and out degree over occipital regions (especially the left and right pericalcarine regions, where the primary visual cortex is located), suggesting that these areas mostly send information to more anterior regions. Hubness and authority appeared to be more sensitive indices than the in degree and out degree. The observed brain connectivity differences suggest that, in individual with higher autistic traits, bottom-up signaling overcomes top-down channeled flow. This imbalance may contribute to some behavioral alterations observed in ASD.

Relationship between electroencephalographic data and comfort perception captured in a Virtual Reality design environment of an aircraft cabin.

Successful aircraft cabin design depends on how the different stakeholders are involved since the first phases of product development. To predict passenger satisfaction prior to the manufacturing phase, human response was investigated in a Virtual Reality (VR) environment simulating a cabin aircraft. Subjective assessments of virtual designs have been collected via questionnaires, while the underlying neural mechanisms have been captured through electroencephalographic (EEG) data. In particular, we focused on the modulation of EEG alpha rhythm as a valuable marker of the brain's internal state and investigated which changes in alpha power and connectivity can be related to a different visual comfort perception by comparing groups with higher and lower comfort rates. Results show that alpha-band power decreased in occipital regions during subjects' immersion in the virtual cabin compared with the relaxation state, reflecting attention to the environment. Moreover, alpha-band power was modulated by comfort perception: lower comfort was associated with a lower alpha power compared to higher comfort. Further, alpha-band Granger connectivity shows top-down mechanisms in higher comfort participants, modulating attention and restoring partial relaxation. Present results contribute to understanding the role of alpha rhythm in visual comfort perception and demonstrate that VR and EEG represent promising tools to quantify human-environment interactions.

Phasic Dopamine Changes and Hebbian Mechanisms during Probabilistic Reversal Learning in Striatal Circuits: A Computational Study.

Cognitive flexibility is essential to modify our behavior in a non-stationary environment and is often explored by reversal learning tasks. The basal ganglia (BG) dopaminergic system, under a top-down control of the pre-frontal cortex, is known to be involved in flexible action selection through reinforcement learning. However, how adaptive dopamine changes regulate this process and learning mechanisms for training the striatal synapses remain open questions. The current study uses a neurocomputational model of the BG, based on dopamine-dependent direct (Go) and indirect (NoGo) pathways, to investigate reinforcement learning in a probabilistic environment through a task that associates different stimuli to different actions. Here, we investigated: the efficacy of several versions of the Hebb rule, based on covariance between pre- and post-synaptic neurons, as well as the required control in phasic dopamine changes crucial to achieving a proper reversal learning. Furthermore, an original mechanism for modulating the phasic dopamine changes is proposed, assuming that the expected reward probability is coded by the activity of the winner Go neuron before a reward/punishment takes place. Simulations show that this original formulation for an automatic phasic dopamine control allows the achievement of a good flexible reversal even in difficult conditions. The current outcomes may contribute to understanding the mechanisms for active control of dopamine changes during flexible behavior. In perspective, it may be applied in neuropsychiatric or neurological disorders, such as Parkinson's or schizophrenia, in which reinforcement learning is impaired.

Decoding sensorimotor information from superior parietal lobule of macaque via Convolutional Neural Networks.

Despite the well-recognized role of the posterior parietal cortex (PPC) in processing sensory information to guide action, the differential encoding properties of this dynamic processing, as operated by different PPC brain areas, are scarcely known. Within the monkey's PPC, the superior parietal lobule hosts areas V6A, PEc, and PE included in the dorso-medial visual stream that is specialized in planning and guiding reaching movements. Here, a Convolutional Neural Network (CNN) approach is used to investigate how the information is processed in these areas. We trained two macaque monkeys to perform a delayed reaching task towards 9 positions (distributed on 3 different depth and direction levels) in the 3D peripersonal space. The activity of single cells was recorded from V6A, PEc, PE and fed to convolutional neural networks that were designed and trained to exploit the temporal structure of neuronal activation patterns, to decode the target positions reached by the monkey. Bayesian Optimization was used to define the main CNN hyper-parameters. In addition to discrete positions in space, we used the same network architecture to decode plausible reaching trajectories. We found that data from the most caudal V6A and PEc areas outperformed PE area in the spatial position decoding. In all areas, decoding accuracies started to increase at the time the target to reach was instructed to the monkey, and reached a plateau at movement onset. The results support a dynamic encoding of the different phases and properties of the reaching movement differentially distributed over a network of interconnected areas. This study highlights the usefulness of neurons' firing rate decoding via CNNs to improve our understanding of how sensorimotor information is encoded in PPC to perform reaching movements. The obtained results may have implications in the perspective of novel neuroprosthetic devices based on the decoding of these rich signals for faithfully carrying out patient's intentions.

Neural Networks and Connectivity among Brain Regions.

As is widely understood, brain functioning depends on the interaction among several neural populations, which are linked via complex connectivity circuits and work together (in antagonistic or synergistic ways) to exchange information, synchronize their activity, adapt plastically to external stimuli or internal requirements, and more generally to participate in solving multifaceted cognitive tasks [...].

Predictive waves in the autism-schizophrenia continuum: A novel biobehavioral model.

The brain is a predictive machine. Converging data suggests a diametric predictive strategy from autism spectrum disorders (ASD) to schizophrenic spectrum disorders (SSD). Whereas perceptual inference in ASD is rigidly shaped by incoming sensory information, the SSD population is prone to overestimate the precision of their priors' models. Growing evidence considers brain oscillations pivotal biomarkers to understand how top-down predictions integrate bottom-up input. Starting from the conceptualization of ASD and SSD as oscillopathies, we introduce an integrated perspective that ascribes the maladjustments of the predictive mechanism to dysregulation of neural synchronization. According to this proposal, disturbances in the oscillatory profile do not allow the appropriate trade-off between descending predictive signal, overweighted in SSD, and ascending prediction errors, overweighted in ASD. These opposing imbalances both result in an ill-adapted reaction to external challenges. This approach offers a neuro-computational model capable of linking predictive coding theories with electrophysiological findings, aiming to increase knowledge on the neuronal foundations of the two spectra features and stimulate hypothesis-driven rehabilitation/research perspectives.

The Directionality of Fronto-Posterior Brain Connectivity Is Associated with the Degree of Individual Autistic Traits.

Altered patterns of brain connectivity have been found in autism spectrum disorder (ASD) and associated with specific symptoms and behavioral features. Growing evidence suggests that the autistic peculiarities are not confined to the clinical population but extend along a continuum between healthy and maladaptive conditions. The aim of this study was to investigate whether a differentiated connectivity pattern could also be tracked along the continuum of autistic traits in a non-clinical population. A Granger causality analysis conducted on a resting-state EEG recording showed that connectivity along the posterior-frontal gradient is sensitive to the magnitude of individual autistic traits and mostly conveyed through fast oscillatory activity. Specifically, participants with higher autistic traits were characterized by a prevalence of ascending connections starting from posterior regions ramping the cortical hierarchy. These findings point to the presence of a tendency within the neural mapping of individuals with higher autistic features in conveying proportionally more bottom-up information. This pattern of findings mimics those found in clinical forms of autism, supporting the idea of a neurobiological continuum between autistic traits and ASD.

A Novel Method to Assess Motor Cortex Connectivity and Event Related Desynchronization Based on Mass Models.

Knowledge of motor cortex connectivity is of great value in cognitive neuroscience, in order to provide a better understanding of motor organization and its alterations in pathological conditions. Traditional methods provide connectivity estimations which may vary depending on the task. This work aims to propose a new method for motor connectivity assessment based on the hypothesis of a task-independent connectivity network, assuming nonlinear behavior. The model considers six cortical regions of interest (ROIs) involved in hand movement. The dynamics of each region is simulated using a neural mass model, which reproduces the oscillatory activity through the interaction among four neural populations. Parameters of the model have been assigned to simulate both power spectral densities and coherences of a patient with left-hemisphere stroke during resting condition, movement of the affected, and movement of the unaffected hand. The presented model can simulate the three conditions using a single set of connectivity parameters, assuming that only inputs to the ROIs change from one condition to the other. The proposed procedure represents an innovative method to assess a brain circuit, which does not rely on a task-dependent connectivity network and allows brain rhythms and desynchronization to be assessed on a quantitative basis.

The Relationship between Oscillations in Brain Regions and Functional Connectivity: A Critical Analysis with the Aid of Neural Mass Models.

Propagation of brain rhythms among cortical regions is a relevant aspect of cognitive neuroscience, which is often investigated using functional connectivity (FC) estimation techniques. The aim of this work is to assess the relationship between rhythm propagation, FC and brain functioning using data generated from neural mass models of connected Regions of Interest (ROIs). We simulated networks of four interconnected ROIs, each with a different intrinsic rhythm (in θ, α, ß and γ ranges). Connectivity was estimated using eight estimators and the relationship between structural connectivity and FC was assessed as a function of the connectivity strength and of the inputs to the ROIs. Results show that the Granger estimation provides the best accuracy, with a good capacity to evaluate the connectivity strength. However, the estimated values strongly depend on the input to the ROIs and hence on nonlinear phenomena. When a population works in the linear region, its capacity to transmit a rhythm increases drastically. Conversely, when it saturates, oscillatory activity becomes strongly affected by rhythms incoming from other regions. Changes in functional connectivity do not always reflect a physical change in the synapses. A unique connectivity network can propagate rhythms in very different ways depending on the specific working conditions.

Alpha and theta mechanisms operating in internal-external attention competition.

Attention is the ability to prioritize a set of information at expense of others and can be internally- or externally-oriented. Alpha and theta oscillations have been extensively implicated in attention. However, it is unclear how these oscillations operate when sensory distractors are presented continuously during task-relevant internal processes, in close-to-real-life conditions. Here, EEG signals from healthy participants were obtained at rest and in three attentional conditions, characterized by the execution of a mental math task (internal attention), presentation of pictures on a monitor (external attention), and task execution under the distracting action of picture presentation (internal-external competition). Alpha and theta power were investigated at scalp level and at some cortical regions of interest (ROIs); moreover, functional directed connectivity was estimated via spectral Granger Causality. Results show that frontal midline theta was distinctive of mental task execution and was more prominent during competition compared to internal attention alone, possibly reflecting higher executive control; anterior cingulate cortex appeared as mainly involved and causally connected to distant (temporal/occipital) regions. Alpha power in visual ROIs strongly decreased in external attention alone, while it assumed values close to rest during competition, reflecting reduced visual engagement against distractors; connectivity results suggested that bidirectional alpha influences between frontal and visual regions could contribute to reduce visual interference in internal attention. This study can help to understand how our brain copes with internal-external attention competition, a condition intrinsic in the human sensory-cognitive interplay, and to elucidate the relationships between brain oscillations and attentional functions/dysfunctions in daily tasks.

An integrative model of Parkinson's disease treatment including levodopa pharmacokinetics, dopamine kinetics, basal ganglia neurotransmission and motor action throughout disease progression.

Levodopa is considered the gold standard treatment of Parkinson's disease. Although very effective in alleviating symptoms at their onset, its chronic use with the progressive neuronal denervation in the basal ganglia leads to a decrease in levodopa's effect duration and to the appearance of motor complications. This evolution challenges the establishment of optimal regimens to manage the symptoms as the disease progresses. Based on up-to-date pathophysiological and pharmacological knowledge, we developed an integrative model for Parkinson's disease to evaluate motor function in response to levodopa treatment as the disease progresses. We combined a pharmacokinetic model of levodopa to a model of dopamine's kinetics and a neurocomputational model of basal ganglia. The parameter values were either measured directly or estimated from human and animal data. The concentrations and behaviors predicted by our model were compared to available information and data. Using this model, we were able to predict levodopa plasma concentration, its related dopamine concentration in the brain and the response performance of a motor task for different stages of disease.

Nonlinear pharmacodynamics of levodopa through Parkinson's disease progression.

The effect of levodopa in alleviating the symptoms of Parkinson's disease is altered in a highly nonlinear manner as the disease progresses. This can be attributed to different compensation mechanisms taking place in the basal ganglia where the dopaminergic neurons are progressively lost. This alteration in the effect of levodopa complicates the optimization of a drug regimen. The present work aims at investigating the nonlinear dynamics of Parkinson's disease and its therapy through mechanistic mathematical modeling. Using a holistic approach, a pharmacokinetic model of levodopa was combined to a dopamine dynamics and a neurocomputational model of basal ganglia. The influence of neuronal death on these different mechanisms was also integrated. Using this model, we were able to investigate the nonlinear relationships between the levodopa plasma concentration, the dopamine brain concentration, and a response to a motor task. Variations in dopamine concentrations in the brain for different levodopa doses were also studied. Finally, we investigated the narrowing of a levodopa therapeutic index with the progression of the disease as a result of these nonlinearities. In conclusion, various consequences of nonlinear dynamics in Parkinson's disease treatment were studied by developing an integrative model. This model paves the way toward individualization of a dosing regimen. Using sensor based information, the parameters of the model could be fitted to individual data to propose optimal individual regimens.